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The present invention relates to a video summary 
description scheme for describing video summary 
by meta data. The video summary provides 
overview functionality, which makes feasible to 
understand overall contents of the original video 
within short time and navigation and browsing 
functionalities, which make feasible to search the 
desired video contents efficiently. According to the , } . 
present invention the HierarchicalSummary 
Description Scheme (DS) comprises at least on [ 
HighlightLevel DS and selectively comprises the 
SummaryThemeList DS. The HightlightLevel DS 
describe highlight level an may have zero or at least 
one lower HighlightLevel DS. The HighlightLevel DS 
comprises one or more HighlightSegment DS which 
is d i n I in Ik lit segment information 

rhe HighlightSegment DS comprises the 
VideoSegmentLocator DS for describing the time 
information of corresponding segment interval. Also, ; " 
the HighlightSegment DS may comprise the 
ImageLocator DS for describing the representative 
mage inform tion f corresponding segment, the 
SoundLocator DS for describing the representative 
sound information, and the AudioSegmentLocator 
DS for describing the audio segment information 
constituting the audio summary. 
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$$$£09 , 4MR*3P ( ffierarchicalSummary) 3f3£;fr|l 
(Description Scheme, DS) M£>&*f— > M»##W& 
(ffighHghtW)DS,#M#ttifc&M^±M^J* 
(SummaryThemeIist)DS 0 Hlfl DS $&Nf$ttR 

ds d W^M^DS^-^^^MTiSM^ffl 

( HighlightSegment) DS„ fjf DS J&*£*t 

^SKfil WBtfiF#f A ^m^m^^# ( VideoSegmentl^ 
cator) DSo 5^Jii®i DS TOfi 



ageLocator) DS,fl|^i»i^«tt^##Jft W WJfcftflF 
( SoundLocator) DS , mm = ?ft&2H&&S*fc& 
flf AflMP«Wfeft#( AudioSegmentLocator) DS D 




Q0814746. 9 



ft « I * =b 



mum 



1. -#ffl-f«at«.«*t#^^-<&*E##iE^-*(DS). «3*fc*fc#DS£ 

io ^-^^^fiist^ei-tti^^ittM 

DS. 

4. rM*#J##3#$#4HMfc##i£;gr£, &*\ DS 
15. St-#^##^^^-i|t^«fi|!t^^*^^A^^*^^DS.. 

^^H^^^©a:^^r4^-i-ft4^^-i-^# DS» 
20 i? & E H # ^4L4t« # N- « ft A* B Hit 

a-^&##k<aA^«^i»«*®&^***#W^*AftA^**& 
st-a ir ds . 

25 9. *»*L*l#*8^^^fe*t*4i6s&^*. *+, 0f 
30 li. *»*t*J**-io^fs£^^ia.*t#«^**, & + , 
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ft *J £ * =fS ^2/515 



5 &#*J#&*£** + #JL48i£lD6&#fc£i-£*J£.DS. & 

13. *»*tsftl#4£.ii^*&^«t*t*#ife**. £+■ 

10 id 

14. :M**J*£l3tfi£tt^te*t##«#£' *t. 

15. ^Mil#£i3#i£#^&#l##&#*. £t> 

DS id id #JL«*£ 

17. -^*t#«*^*##***(DS)^-H-*^***^*' « 

# Jft & DS £ ^ — 'HS* * fi tBLMii&&&M # & 

# « ft # *f r«i -ft A # **ft Jt&# DS o 
25 3£»#j;5f&> &#*»T#«: 

30 *'] . jyu*& 1*1 IE fa) , ia&fcE#ft« £ N ft A ; 
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K « S * 1? 113/551 



«M E fi) it & , DS j* £M#fc##i£M o 

5 «tt ds £^ fc#-^««teA^*^**<a.^*#ft*^j»«#»« 

fl A^lffr^MDS, *t^*»^*ie&DS 
*&^b^«J^ AjS,*^*^***^^ DS . 

H E $ . & >I'J & ^£ IW^Ifff; 
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ft *J 51 * ^ ^4/5^ 



E RJ s£#lNfc . it it* A/3f i£&i»'J f'J #*»0rifrfft##, *■] . 
ft#*t*4* & . it i± # A * 0f s£ft * a fil * # $T A # * # 

25. -#3ft3i*A^^^*^#|l^##^**iA*«*#*S^ft 

ft#^#r*t4. «-fiiii#A^*«,«i4J.^*f****. *rife*,«^ 
E isi i£#i£t £ . flj f-it i» A#f i££ ^ # iE#t 

ft A; 

26. £25 

M & DS £ ^ fe#->M*i£ i&&*P >Nfr# ^7 i& & 
20 tB ft « # A *■ * # Jt^4f DS . 

#*MfcJMtJL. ffl-f5|ii4|AJ*^«.«#X|l*.#4i£. $r£i«#« 
25 ^##r«S> ffl^^iilfrA^#*£*3l^a'J*ja*#4E^«-«^ 

28. io«lt->l-25^^^*«^^^i:#i^^^' £t» #r« 
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ft * 'J W: * 4S 3g5/5K 



29. ^WJ**25^^«.**l#««ft*4A*fe. 

30. *»*l^#4t25^^«.*#t#««ft#4.A*«.. 

5 &fefl.4Ui* ****** ffl^5lst*X*fiMlt***aNitA*JMl^ 
* , **#*#■&#.#*£##&** . 

31. -sft*t#«*-^^^if-**L^«'i&*^*. mmn^&ft 

*»T*4 : 

m%mM&.Hit&> 4t®fr%L%t$rDs . 

25 tfft*ifc#»J!fcfrJMifc. 
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J£l/i33i 



5 

. * -f ^ a n #-*M£$- fc^a**t# t 

1*3 

# j8 ^ " Method and apparatus for video browsing based on content and 
structure^ T&Tft&fr&fttt&Mm%ti*%fr$L$.y 
5,821,945 #JLitii-^4*^^r°lM^f 
30 #$JS# Si 
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$ m $ *2/i3M 



-% ■« ^ m & & & , % t ^ k ^ a« ffl «.*«^ ^ & 

5 ISO /IEC JTC1/SC29/WG1 1 MPEG-7 $T * iLfe ^ N2844 £ 1999 4 7 /3 

#r^i§ MPEG-7 #^^rt(V 0.5)11 &ft#*t##S*E#* . &f"^t$i£ 

t & > — +tk A * £ * mMtt#t«^HM^il#«^i» 

15 

% 1 & ®M n #} > W *T&*t 7fi&\ ¥i ^»^(HierarchicalSumm 

-ary)DS 5. 4 V fe#--'M$a£*fr#*iBfe#*fr#*« ^(HighlightLevel) DS. 4 

it ,1 # * ^^(HighlightSegment) DS . 

i$M&% 6^£#^:^^-||(VideoSegmentLocator) DS . 

$ S &&&#(ImageLocator) DS . 

•f ft 4 ^ £ -f- 5tte#(SoundLocator)DS . 

8 



00814746. 9 



« m =B SI3/1351 



H&te^ DS ^#iWiEJtf& -frfti&tt^ -fritte 

If DS o 

. @ <L jfc<& % DS *5 & 4 H B. *fr # * tfj # M E f«l 6§ ft 

5 ft N" fii # a i» . 

*t# # -fr jIB&ft &¥} -f M&&te#(AudioSegmentLocator)DS . 

# H SI (SummaryComponentTVpe)^ *E.# 4(SummaryComponent- 
List) . 

ID ^fe*i«^4L(SummaryThemeList)DS. ^^JH^fl^fc, 
i«St— : ^&&483£i-&#^#i3<,.£.;S§ id ID(parentID)^'l± . 

20 ^*teA^*^*fife^^f*ll^»®A*»»«*®*s.*** 

« id i:(themelds)^'14« 

DS &#4*s£#f3£ id A id £(themelds)&'£> 

25 &#-#& + #fit##fete*DS#tt£^«-fc 

M fy&Mtf ® it ft $M8l%Jzl% DS . 
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m =fj sg4/i3H 



tai±4frA^a|#^*^^»|*}ii*#^«,*Ht«l E IS) , #riS'J 

at fal E 13 ; **Nfc»| jfrJ* , afiii^ A^f i^tell^jfa^ *J &#4frfc 

tym, mii^A*^f^#^E^^##«*^#t^^Er«]if4 5 € 
$ DS iAtttl^Itl . 

30 =8U*fr#ffcl. ffl-fiiii&A 

10 
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jfcilffl ******* E «tt*#ftffl; MM E 

BE]. EEf^; #*ll**t#.#i£&£. « "fat it 

s. 

SUfiJii^#4iE^^fi£a*Ht|5|B|Bl, #r»|fei^«t# + ^M|fr; # 
11 
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{ft m =tS SS6/13JH 



3 *h > IH* - 0L *T ^ ** SI £ * ft . 

*t*#*#fc*#i£ft#±£*ft, «*ftj|ii*A 

warn* 

; 

m 2 UML(Unified Modeling Language, ft*r-*&«1r)* 

DS ; 

101 - ^##r*J^^ 102^ ^ 103^ *t*«.*BRlj&#*P^ 104- 

25 105 > ft;SU&tt&JMP^ 106 > ft;MM-fr*JMP^ 107 

^&#H?U&-&i£^3* 108 « 

101 iiii^A^^#^^^^^M^ft^#^» - 
> > #^ E iESE . 

12 
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% m =tS SS7/13J[ 



^i 0l JttfW^|/XT. 1 100~150)&^£ 100-150 

* *N«#^ 102 #r$'l &^£«M t # . 

200 *J 300 ^ 4: ft # - # n # * *H* A . 
20 Eft- 

e r«i . Jt*^ 105 r«3 

30 M£JM«^iW^108o 

#E#a«E«a#<P^ 104 tfc#*MMM^Efl*W3# 

13 
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& m % M8/131K 



A. #£**J&ft^«tf&ti*#*ai. 4*t*. (100-200. «), 
(500-700 > #ri)**-i5,*.*ab'ft«t#«,*ERl^*«*ti& 100-200 «. 

500-700 4JL««^^^»i>&si^jjtn . #*h, *r 

£ ^ ft 4 . J»i& fl-fete A*t#*tf E im fi$ Pfj-^M o 
5 «««*0ENiy?:> fifilfc A. ^AUUt 

'1£$&*M|S^ 106 ^-ft^MijS -HfcJMiJfr 107 ft^ft^tett^-fUMM * . 

106 Hr A E W ^ H -f- * B&ft 

<fl&<!±> -NfcJMP^ 107 & ft E Htfjp 

10 atiijEfa). 

««^#^ 108 WS2^6§M a ^^^M^l7t^ 

I2^tffl UML(Unified Modeling Language, tt,— 
###:$ft#te*#$33r$#^MJt* DS ffl . 

201 4*ifc#->H^'Ht#^i6fcDS 202 >-*#*>Nft 
20 ^JlMPIA DS 203 . 

-f f 4fr$*ffi&DS202 *#^tt^*fiADS204 

jfp^^iS-f- >Nt##d&feDS *t#«*t6*DS 204 

^&<Kiat*#,*fi$*.* e « it . 

&-^&i&&Jt'fr#DS205. S^M^-fg #.£te$ : DS206. *^35,'#-f 
^ DS 207 Jtte# 208 fc/fc . 

30 -f-DS 

14 
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ffi »l ^ H9/13K 



M E W . »r4^ * E fil * ft ^^t-g-M 

£t JM$i£ ID ^*t#i«?J4L DS ■ 

10 iBE*^^*.^^** a • «t#i.«**-^ ID 

«#id&'H> #JJaMH£*fc*#--*£idA't£. 

13 it3i#i^4^^^^ToC(Table of Content, 

20 **#*#J^B>t*(Ji£±*). 

$ # ^*l*E* DS £ >M*# » fi fe DS , # JMfr * * fe 

DSo 

*fr# «r & DS IDREFS £31 # ±S id & & . 
25 iJ8 id DS##^&##*&DS» 

^■giJ*^*«*lt^^**^*fi-&DS # id. #J.«id£#r 

i£#t#£.«*J4t DS + 

30 ^^M^PWWtfia-Hf 

A DS DS ^SI-tM 
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itt W IS » 10/1 335 



DS, DS DS . 

- @ It^l DS ^^tf t^^Mtt^ I l»f -I • 
DS #i£4l*#&#,#.ftB H#J? -Ht.t- o DS #s£fc/8,-t-# 

15 DS* af.lS:^#DS^^-|-^^^DS. ^MiiS! Affl-T-#a£«iiL#t 

£&*f ft j*j T mm E « $ f*3 4 * E « » sfc^Ni E fil ft 

25 ft*»afc*P^301 M^/ , ^^f'J#«^^#^M*Mo 

iX&im^fr 305 £&-&*J/L 

30 IS --- «^^-^^ii#L#^^^ . 
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{ft BJ S611/13K 



teM^H^&'li^ -f-#^ 306 &*ft;Mst4Mfcl8& 0 %>U%$LM%l 1 

*R # ft -t- a *S # t/XT , IE fil # ft;MM -t - 

302 & A$ /> 

15 - «M#ft4U:t#, ^ 406 ^H,*. 

•lit* 405. 

0 401 ^JXMsftE****. 1 403 £t^Wlf»^ . 
*t***fel 0 k^££#l*3^. 0^4Hi« 402 

20 0 ttft&tett • #JMR##.#& 1 ft*.**!* 404 

1 ^Wll- 

MM^&^Mitsta 3 ^*M#«^30i tlrM- 

SI 0 ft4M£M£*E*&«& 0 ft^tt^ft&te/ 6 "HP^ 306 t^.ft* 

l ft;M£tt£*E#ft#fe i ft;Mfc«frft*4£/***Pfr307 t&^> 

a 4^^^^«i^>*^r^* ; t^^^^^^^' teT&^frm 

^ : 

t X 1 : (l)-(2) 

lf/X2: (l)-(3)-(5) 
30 tfX 3 : (l)-(3)-(4)-(6) 

•ffX4: (7) -(5) 
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& m 45 »12/13K 



tX5: (7)-(4)-(6) 
ft#Mf ^#«M«tO st^MI^. 1 . 

15 

20 *fr3L 1 : #Mt^$L$!& 0, # JLjyi*t***i5. 0 ft&'&tt JLtttffl* 

'Jf;JL 2 : 4fcSbft*#.#fe 0. # J.JMft##.#fc 0 4UL4£ 

25 M ° 

<lfX 3 : & 2 ^«jyL****fe. 1 ft£&foi*fs\J&-&$LM*tlftX>T, 

18 
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% m 45 KS13/13W 



«^&fe-g-#i£35-£, i*i<l*ftfc#«i£ft*, ^JL*«-^r«*^f^i»4& 



19 



n 



M 



1*1 <* 

1! 
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% m 43 m m 
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iia m # m m « 3/435 



302 
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% « =ts m s mi/iis. 



(D 



fcg-«Mo 402 



(3) 



Mil - 1 1 1 
406 



404 
i (5) 



405 
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